2025-04-03 23:18:11,804 [ 351685 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-03 23:18:11,805 [ 351685 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-03 23:18:11,805 [ 351685 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-03 23:18:11,805 [ 351685 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_8fncjv --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv" altinityinfra/integration-tests-runner:cd6390247eca '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: random-0.2, timeout-2.2.0, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum test_replicated_database/test.py::test_all_groups_cluster test_s3_cluster/test.py::test_ambiguous_join test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_redirect_url_storage/test.py::test_predefined_connection_configuration test_reload_client_certificate/test.py::test_correct_cn_cert test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] [gw9] [ 1%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] [gw9] [ 2%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] [gw8] [ 3%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw1] [ 4%] PASSED test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression [gw0] [ 5%] PASSED test_replicated_database/test.py::test_all_groups_cluster test_replicated_database/test.py::test_alter_attach[MergeTree] [gw9] [ 6%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] [gw2] [ 7%] PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] [gw3] [ 8%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] [gw2] [ 9%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] [gw0] [ 10%] PASSED test_replicated_database/test.py::test_alter_attach[MergeTree] test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] [gw3] [ 11%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] [gw8] [ 12%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw5] [ 13%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] [gw1] [ 14%] PASSED test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection [gw0] [ 15%] PASSED test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_detach_part[MergeTree] [gw2] [ 16%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection test_prometheus_endpoint/test.py::test_prometheus_endpoint [gw3] [ 17%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] [gw5] [ 18%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] [gw0] [ 19%] PASSED test_replicated_database/test.py::test_alter_detach_part[MergeTree] test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] [gw1] [ 20%] PASSED test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header [gw3] [ 21%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] [gw1] [ 22%] PASSED test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_read_temporary_tables_on_failure/test.py::test_different_versions [gw0] [ 23%] PASSED test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] [gw1] [ 24%] PASSED test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count [gw3] [ 25%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] [gw0] [ 26%] PASSED test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] [gw1] [ 27%] PASSED test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro [gw1] [ 28%] PASSED test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated [gw7] [ 29%] PASSED test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert [gw0] [ 30%] PASSED test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_part[MergeTree] [gw3] [ 31%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] [gw2] [ 32%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] [gw8] [ 33%] PASSED test_prometheus_endpoint/test.py::test_prometheus_endpoint [gw0] [ 34%] PASSED test_replicated_database/test.py::test_alter_drop_part[MergeTree] test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] [gw9] [ 35%] PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions [gw1] [ 36%] PASSED test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_regexp_logger/test.py::test_regexp_pattern_update [gw0] [ 37%] PASSED test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_partition[MergeTree] [gw2] [ 38%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] test_recovery_time_metric/test.py::test_recovery_time_metric [gw4] [ 39%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] [gw4] [ 40%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format [gw6] [ 41%] PASSED test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs [gw6] [ 42%] PASSED test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover [gw1] [ 43%] PASSED test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning [gw0] [ 44%] PASSED test_replicated_database/test.py::test_alter_drop_partition[MergeTree] test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] [gw6] [ 45%] PASSED test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed [gw6] [ 46%] PASSED test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed [gw2] [ 47%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] test_quorum_inserts/test.py::test_insert_quorum_with_ttl [gw4] [ 48%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] [gw4] [ 49%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] [gw6] [ 50%] PASSED test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect [gw6] [ 51%] PASSED test_redirect_url_storage/test.py::test_url_without_redirect [gw0] [ 52%] PASSED test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_fetch [gw4] [ 53%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] [gw1] [ 54%] PASSED test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference [gw0] [ 55%] PASSED test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas [gw1] [ 56%] PASSED test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged [gw1] [ 57%] PASSED test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged [gw3] [ 58%] PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw1] [ 59%] PASSED test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all [gw4] [ 60%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] [gw1] [ 61%] PASSED test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards [gw5] [ 62%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] [gw1] [ 63%] PASSED test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all [gw8] [ 64%] PASSED test_regexp_logger/test.py::test_regexp_pattern_update [gw1] [ 65%] PASSED test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_replica_can_become_leader/test.py::test_can_become_leader [gw1] [ 66%] PASSED test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster [gw2] [ 67%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica [gw4] [ 68%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] [gw1] [ 69%] PASSED test_s3_cluster/test.py::test_wrong_cluster test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers [gw9] [ 70%] PASSED test_recovery_time_metric/test.py::test_recovery_time_metric [gw2] [ 71%] PASSED test_quorum_inserts/test.py::test_simple_add_replica test_reload_zookeeper/test.py::test_reload_zookeeper [gw4] [ 72%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw4] [ 73%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw3] [ 74%] PASSED test_replica_can_become_leader/test.py::test_can_become_leader test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable [gw8] [ 75%] PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_s3_assume_role/test.py::test_using_assumed_creds [gw5] [ 76%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] test_polymorphic_parts/test.py::test_polymorphic_parts_index [gw5] [ 77%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive [gw5] [ 78%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive [gw0] [ 79%] PASSED test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery [gw3] [ 80%] PASSED test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable [gw8] [ 81%] FAILED test_s3_assume_role/test.py::test_using_assumed_creds [gw9] [ 82%] PASSED test_reload_zookeeper/test.py::test_reload_zookeeper [gw0] [ 83%] PASSED test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table test_send_crash_reports/test.py::test_send_segfault [gw0] [ 84%] PASSED test_replicated_database/test.py::test_create_replicated_table test_replicated_database/test.py::test_delete_from_table[MergeTree] [gw0] [ 85%] PASSED test_replicated_database/test.py::test_delete_from_table[MergeTree] test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] [gw0] [ 86%] PASSED test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] test_replicated_database/test.py::test_detach_attach_table [gw9] [ 87%] SKIPPED test_send_crash_reports/test.py::test_send_segfault [gw0] [ 88%] PASSED test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested [gw0] [ 89%] PASSED test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings [gw0] [ 90%] PASSED test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment [gw7] [ 91%] PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert test_session_log/test.py::test_grpc_session [gw0] [ 92%] PASSED test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch [gw7] [ 93%] PASSED test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session [gw7] [ 94%] PASSED test_session_log/test.py::test_mysql_session [gw0] [ 95%] PASSED test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter [gw0] [ 96%] PASSED test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid [gw0] [ 97%] PASSED test_replicated_database/test.py::test_server_uuid test_replicated_database/test.py::test_simple_alter_table[MergeTree] [gw0] [ 98%] PASSED test_replicated_database/test.py::test_simple_alter_table[MergeTree] test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] [gw0] [ 99%] PASSED test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] test_replicated_database/test.py::test_table_metadata_corruption [gw0] [100%] PASSED test_replicated_database/test.py::test_table_metadata_corruption =================================== FAILURES =================================== ___________________________ test_using_assumed_creds ___________________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_using_assumed_creds(started_cluster): instance = started_cluster.instances["node1"] # Create some file in non public-accessible minio > instance.query( """ INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); """ ) test_s3_assume_role/test.py:46: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3678: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 243, stderr: Received exception from server (version 24.12.2): E Code: 499. DB::Exception: Received from 172.16.3.6:9000. DB::Exception: Failed to check existence of key test_assume.csv in bucket root: No response body.. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000020b12e03 E 1. ./build_docker/./src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x00000000103e9a74 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x0000000007ba1ade E 3. ./src/IO/S3Common.h:36: DB::S3Exception::S3Exception(Aws::S3::S3Errors, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, String const&, String const&) @ 0x0000000017a4d798 E 4. ./build_docker/./src/IO/S3/getObjectInfo.cpp:120: DB::S3::objectExists(DB::S3::Client const&, String const&, String const&, String const&) @ 0x0000000017a4d004 E 5. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:164: DB::S3ObjectStorage::exists(DB::StoredObject const&) const @ 0x0000000017a3ba4a E 6. ./build_docker/./src/Storages/ObjectStorage/Utils.cpp:21: DB::checkAndGetNewFileOnInsertIfNeeded(DB::IObjectStorage const&, DB::StorageObjectStorage::Configuration const&, DB::StorageObjectStorage::QuerySettings const&, String const&, unsigned long) @ 0x000000001794f9e1 E 7. ./build_docker/./src/Storages/ObjectStorage/StorageObjectStorage.cpp:402: DB::StorageObjectStorage::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000001786d2e2 E 8. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:620: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, unsigned long, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x000000001c9fcdc6 E 9. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:365: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, unsigned long, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x0000000019926600 E 10. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:451: DB::InterpreterInsertQuery::buildPreAndSinkChains(unsigned long, unsigned long, std::shared_ptr, unsigned long, std::shared_ptr const&, DB::Block const&) @ 0x000000001992751f E 11. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:649: DB::InterpreterInsertQuery::buildInsertSelectPipeline(DB::ASTInsertQuery&, std::shared_ptr) @ 0x0000000019929b12 E 12. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:818: DB::InterpreterInsertQuery::execute() @ 0x000000001992d0b7 E 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x0000000019e31339 E 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x0000000019e2c356 E 15. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x000000001c419585 E 16. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x000000001c437fe8 E 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000020c1f9c3 E 18. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x0000000020c20232 E 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000020b99003 E 20. ./build_docker/./base/poco/Foundation/src/Thread.cpp:45: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x0000000020b972b0 E 21. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x0000000020b9578a E 22. __tsan_thread_start_func @ 0x0000000007b14428 E 23. ? @ 0x00007fb12086fac3 E 24. ? @ 0x00007fb120901850 E . (S3_ERROR) E (query: INSERT INTO FUNCTION s3 E ( E 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' E ) E SELECT number as num, toString(number) as strnum FROM numbers(5);) helpers/client.py:248: QueryRuntimeException ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 5dc086be9191 ENV SHLVL 0 ENV HOME /root ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 6712d5cc610d ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30400 30401 30402 30403 30404 30405 30406 30407 30408 30409 30410 30411 30412 30413 30414 30415 30416 30417 30418 30419 30420 30421 30422 30423 30424 30425 30426 30427 30428 30429 30430 30431 30432 30433 30434 30435 30436 30437 30438 30439 30440 30441 30442 30443 30444 30445 30446 30447 30448 30449 ENV PYTEST_XDIST_TESTRUNUID 62949f8a57424540b2e86896e4d49bca ENV PYTEST_XDIST_WORKER gw8 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_s3_assume_role/test.py::test_using_assumed_creds (setup) CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3assumerole-gw8. Added instance name:node1 tag:6712d5cc610d base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env', '--project-name', 'roottests3assumerole-gw8', '--file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_assume_role/test.py Cluster start called. is_up=False Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME Cleanup called Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3assumerole-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottests3assumerole-gw8 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:4 Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Volumes pruned: 4 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for common tests configuration Copy common configuration from helpers Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/database Setup logs dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Stderr: proxy1 Skipped - Image is already being pulled by proxy2 Stderr: node1 Pulling Stderr: proxy2 Pulling Stderr: resolver Pulling Stderr: minio1 Pulling Stderr: proxy2 Pulled Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: node1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3assumerole-gw8 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3assumerole-gw8 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-03T23:21:02Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3assumerole-gw8_default Creating Stderr: Network roottests3assumerole-gw8_default Created Stderr: Volume "roottests3assumerole-gw8_data1-1" Creating Stderr: Volume "roottests3assumerole-gw8_data1-1" Created Stderr: Container roottests3assumerole-gw8-proxy2-1 Creating Stderr: Container roottests3assumerole-gw8-proxy1-1 Creating Stderr: proxy1 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested Stderr: proxy2 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested Stderr: Container roottests3assumerole-gw8-proxy1-1 Created Stderr: Container roottests3assumerole-gw8-proxy2-1 Created Stderr: Container roottests3assumerole-gw8-minio1-1 Creating Stderr: Container roottests3assumerole-gw8-resolver-1 Creating Stderr: Container roottests3assumerole-gw8-minio1-1 Created Stderr: Container roottests3assumerole-gw8-resolver-1 Created Stderr: Container roottests3assumerole-gw8-proxy2-1 Starting Stderr: Container roottests3assumerole-gw8-proxy1-1 Starting Stderr: Container roottests3assumerole-gw8-proxy1-1 Started Stderr: Container roottests3assumerole-gw8-proxy2-1 Started Stderr: Container roottests3assumerole-gw8-minio1-1 Starting Stderr: Container roottests3assumerole-gw8-resolver-1 Starting Stderr: Container roottests3assumerole-gw8-resolver-1 Started Stderr: Container roottests3assumerole-gw8-minio1-1 Started Stderr:time="2025-04-03T23:21:04Z" level=debug msg="otel error" error="" Stderr:time="2025-04-03T23:21:04Z" level=debug msg="otel error" error="" Trying to connect to Minio... get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.3.4:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.3.4:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.3.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Starting new HTTP connection (5): 172.16.3.4:9001 http://172.16.3.4:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. http://172.16.3.4:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created http://172.16.3.4:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.3.4:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Stderr: Container roottests3assumerole-gw8-proxy1-1 Running Stderr: Container roottests3assumerole-gw8-proxy2-1 Running Stderr: Container roottests3assumerole-gw8-resolver-1 Running Stderr: Container roottests3assumerole-gw8-minio1-1 Running Stderr: Container roottests3assumerole-gw8-node1-1 Creating Stderr: Container roottests3assumerole-gw8-node1-1 Created Stderr: Container roottests3assumerole-gw8-node1-1 Starting Stderr: Container roottests3assumerole-gw8-node1-1 Started ClickHouse instance created get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.3.6... http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None ClickHouse node1 started Starting mock server mock_sts.py run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py'] Command:[docker exec roottests3assumerole-gw8-resolver-1 bash -c echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py] run container_id:roottests3assumerole-gw8-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log'] Command:[docker exec roottests3assumerole-gw8-resolver-1 bash -c python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log] run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] Command:[docker exec roottests3assumerole-gw8-resolver-1 curl -s http://localhost:8081/] Exitcode:7 run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] Command:[docker exec roottests3assumerole-gw8-resolver-1 curl -s http://localhost:8081/] Stdout:OK mock_sts.py answered OK on attempt 2 Mock server mock_sts.py started ------------------------------ Captured log setup ------------------------------ 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV HOSTNAME 5dc086be9191 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV SHLVL 0 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV HOME /root (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV OLDPWD / (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV TZ Etc/UTC (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV DOCKER_BASE_TAG 6712d5cc610d (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV WORKER_FREE_PORTS 30400 30401 30402 30403 30404 30405 30406 30407 30408 30409 30410 30411 30412 30413 30414 30415 30416 30417 30418 30419 30420 30421 30422 30423 30424 30425 30426 30427 30428 30429 30430 30431 30432 30433 30434 30435 30436 30437 30438 30439 30440 30441 30442 30443 30444 30445 30446 30447 30448 30449 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 62949f8a57424540b2e86896e4d49bca (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTEST_XDIST_WORKER gw8 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : ENV PYTEST_CURRENT_TEST test_s3_assume_role/test.py::test_using_assumed_creds (setup) (cluster.py:450, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:774, __init__) 2025-04-03 23:20:51 [ 698 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1729, add_instance) 2025-04-03 23:20:51 [ 698 ] DEBUG : Cluster name: project_name:roottests3assumerole-gw8. Added instance name:node1 tag:6712d5cc610d base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env', '--project-name', 'roottests3assumerole-gw8', '--file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2025, add_instance) 2025-04-03 23:20:51 [ 698 ] INFO : Starting cluster... (test.py:32, started_cluster) 2025-04-03 23:20:51 [ 698 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_assume_role/test.py (cluster.py:2793, start) 2025-04-03 23:20:51 [ 698 ] DEBUG : Cluster start called. is_up=False (cluster.py:2800, start) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:20:51 [ 698 ] DEBUG : Command:[docker container list --all --filter name='^/roottests3assumerole-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : No running containers for project: roottests3assumerole-gw8 (cluster.py:922, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Stdout:4 (cluster.py:146, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Command:[docker volume prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:20:51 [ 698 ] DEBUG : Volumes pruned: 4 (cluster.py:958, cleanup) 2025-04-03 23:20:51 [ 698 ] DEBUG : Setup directory for instance: node1 (cluster.py:2813, start) 2025-04-03 23:20:51 [ 698 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4639, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Create directory for common tests configuration (cluster.py:4644, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Copy common configuration from helpers (cluster.py:4664, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Generate and write macros file (cluster.py:4716, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/configs/config.d (cluster.py:4752, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/database (cluster.py:4769, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs (cluster.py:4780, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4864, create_dir) 2025-04-03 23:20:51 [ 698 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env (cluster.py:97, _create_env_file) 2025-04-03 23:20:51 [ 698 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 23:20:51 [ 698 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 23:20:51 [ 698 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 23:20:51 [ 698 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 23:20:51 [ 698 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-03 23:20:51 [ 698 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] (cluster.py:122, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: proxy1 Skipped - Image is already being pulled by proxy2 (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: node1 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: proxy2 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: resolver Pulling (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: minio1 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: proxy2 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: resolver Pulled (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: minio1 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] DEBUG : Stderr: node1 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:21:02 [ 698 ] INFO : Trying to create Minio instance by command docker compose --project-name roottests3assumerole-gw8 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d (cluster.py:3132, start) 2025-04-03 23:21:02 [ 698 ] DEBUG : Command:[docker compose --project-name roottests3assumerole-gw8 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] (cluster.py:122, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr:time="2025-04-03T23:21:02Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Network roottests3assumerole-gw8_default Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Network roottests3assumerole-gw8_default Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Volume "roottests3assumerole-gw8_data1-1" Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Volume "roottests3assumerole-gw8_data1-1" Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: proxy1 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: proxy2 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr:time="2025-04-03T23:21:04Z" level=debug msg="otel error" error="" (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] DEBUG : Stderr:time="2025-04-03T23:21:04Z" level=debug msg="otel error" error="" (cluster.py:148, run_and_check) 2025-04-03 23:21:04 [ 698 ] INFO : Trying to connect to Minio... (cluster.py:3138, start) 2025-04-03 23:21:04 [ 698 ] DEBUG : get_instance_ip instance_name=minio1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:21:04 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-minio1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:04 [ 698 ] DEBUG : get_instance_ip instance_name=proxy1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:21:04 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-proxy1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:04 [ 698 ] DEBUG : Starting new HTTP connection (1): 172.16.3.4:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:21:04 [ 698 ] DEBUG : Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:21:04 [ 698 ] WARNING : Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:21:04 [ 698 ] DEBUG : Starting new HTTP connection (2): 172.16.3.4:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:21:04 [ 698 ] DEBUG : Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:21:04 [ 698 ] WARNING : Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:21:04 [ 698 ] DEBUG : Starting new HTTP connection (3): 172.16.3.4:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:21:04 [ 698 ] DEBUG : Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:21:04 [ 698 ] WARNING : Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:21:04 [ 698 ] DEBUG : Starting new HTTP connection (4): 172.16.3.4:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:21:04 [ 698 ] DEBUG : Can't connect to Minio: HTTPConnectionPool(host='172.16.3.4', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) (cluster.py:2637, wait_minio_to_start) 2025-04-03 23:21:05 [ 698 ] DEBUG : Starting new HTTP connection (5): 172.16.3.4:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://172.16.3.4:9001 "GET / HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : Connected to Minio. (cluster.py:2617, wait_minio_to_start) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://172.16.3.4:9001 "GET /root?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://172.16.3.4:9001 "PUT /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : S3 bucket 'root' created (cluster.py:2632, wait_minio_to_start) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://172.16.3.4:9001 "GET /root2?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://172.16.3.4:9001 "PUT /root2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : S3 bucket 'root2' created (cluster.py:2632, wait_minio_to_start) 2025-04-03 23:21:05 [ 698 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') (cluster.py:3200, start) 2025-04-03 23:21:05 [ 698 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] (cluster.py:122, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:21:05 [ 698 ] DEBUG : ClickHouse instance created (cluster.py:3208, start) 2025-04-03 23:21:05 [ 698 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2092, get_instance_global_ipv6) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.3.6... (cluster.py:3216, start) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw8-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:05 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:06 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:07 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : http://localhost:None "GET /v1.46/containers/93d359c89450491f4fff50b491f5578cca5ee0b5099176289dcdeb104c16b9b4/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:21:08 [ 698 ] DEBUG : ClickHouse node1 started (cluster.py:3220, start) 2025-04-03 23:21:08 [ 698 ] INFO : Starting mock server mock_sts.py (mock_servers.py:18, start_mock_servers) 2025-04-03 23:21:08 [ 698 ] DEBUG : run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py'] (cluster.py:2126, exec_in_container) 2025-04-03 23:21:08 [ 698 ] DEBUG : Command:[docker exec roottests3assumerole-gw8-resolver-1 bash -c echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py] (cluster.py:122, run_and_check) 2025-04-03 23:21:08 [ 698 ] DEBUG : run container_id:roottests3assumerole-gw8-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log'] (cluster.py:2126, exec_in_container) 2025-04-03 23:21:08 [ 698 ] DEBUG : Command:[docker exec roottests3assumerole-gw8-resolver-1 bash -c python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log] (cluster.py:122, run_and_check) 2025-04-03 23:21:08 [ 698 ] DEBUG : run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2126, exec_in_container) 2025-04-03 23:21:08 [ 698 ] DEBUG : Command:[docker exec roottests3assumerole-gw8-resolver-1 curl -s http://localhost:8081/] (cluster.py:122, run_and_check) 2025-04-03 23:21:08 [ 698 ] DEBUG : Exitcode:7 (cluster.py:150, run_and_check) 2025-04-03 23:21:09 [ 698 ] DEBUG : run container_id:roottests3assumerole-gw8-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2126, exec_in_container) 2025-04-03 23:21:09 [ 698 ] DEBUG : Command:[docker exec roottests3assumerole-gw8-resolver-1 curl -s http://localhost:8081/] (cluster.py:122, run_and_check) 2025-04-03 23:21:09 [ 698 ] DEBUG : Stdout:OK (cluster.py:146, run_and_check) 2025-04-03 23:21:09 [ 698 ] DEBUG : mock_sts.py answered OK on attempt 2 (mock_servers.py:67, start_mock_servers) 2025-04-03 23:21:09 [ 698 ] INFO : Mock server mock_sts.py started (mock_servers.py:82, start_mock_servers) ----------------------------- Captured stderr call ----------------------------- Executing query INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); on node1 ------------------------------ Captured log call ------------------------------- 2025-04-03 23:21:09 [ 698 ] DEBUG : Executing query INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); on node1 (cluster.py:3677, query) --------------------------- Captured stderr teardown --------------------------- Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Stderr: Container roottests3assumerole-gw8-node1-1 Stopping Stderr: Container roottests3assumerole-gw8-resolver-1 Stopping Stderr: Container roottests3assumerole-gw8-node1-1 Stopped Stderr: Container roottests3assumerole-gw8-minio1-1 Stopping Stderr: Container roottests3assumerole-gw8-minio1-1 Stopped Stderr: Container roottests3assumerole-gw8-resolver-1 Stopped Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopping Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopping Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopped Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottests3assumerole-gw8-resolver-1 Stopping Stderr: Container roottests3assumerole-gw8-node1-1 Stopping Stderr: Container roottests3assumerole-gw8-resolver-1 Stopped Stderr: Container roottests3assumerole-gw8-resolver-1 Removing Stderr: Container roottests3assumerole-gw8-node1-1 Stopped Stderr: Container roottests3assumerole-gw8-node1-1 Removing Stderr: Container roottests3assumerole-gw8-resolver-1 Removed Stderr: Container roottests3assumerole-gw8-node1-1 Removed Stderr: Container roottests3assumerole-gw8-minio1-1 Stopping Stderr: Container roottests3assumerole-gw8-minio1-1 Stopped Stderr: Container roottests3assumerole-gw8-minio1-1 Removing Stderr: Container roottests3assumerole-gw8-minio1-1 Removed Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopping Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopping Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopped Stderr: Container roottests3assumerole-gw8-proxy1-1 Removing Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopped Stderr: Container roottests3assumerole-gw8-proxy2-1 Removing Stderr: Container roottests3assumerole-gw8-proxy1-1 Removed Stderr: Container roottests3assumerole-gw8-proxy2-1 Removed Stderr: Volume roottests3assumerole-gw8_data1-1 Removing Stderr: Network roottests3assumerole-gw8_default Removing Stderr: Volume roottests3assumerole-gw8_data1-1 Removed Stderr: Network roottests3assumerole-gw8_default Removed Cleanup called Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3assumerole-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottests3assumerole-gw8 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:4 Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Volumes pruned: 4 ---------------------------- Captured log teardown ----------------------------- 2025-04-03 23:21:11 [ 698 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] (cluster.py:122, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:122, run_and_check) 2025-04-03 23:21:31 [ 698 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/.env --project-name roottests3assumerole-gw8 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw8/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] (cluster.py:122, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-resolver-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-node1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-minio1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Container roottests3assumerole-gw8-proxy2-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Volume roottests3assumerole-gw8_data1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Network roottests3assumerole-gw8_default Removing (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Volume roottests3assumerole-gw8_data1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stderr: Network roottests3assumerole-gw8_default Removed (cluster.py:148, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Docker networks for project roottests3assumerole-gw8 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:21:32 [ 698 ] DEBUG : Docker containers for project roottests3assumerole-gw8 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:21:32 [ 698 ] DEBUG : Docker volumes for project roottests3assumerole-gw8 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:21:32 [ 698 ] DEBUG : Command:[docker container list --all --filter name='^/roottests3assumerole-gw8-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : No running containers for project: roottests3assumerole-gw8 (cluster.py:922, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 23:21:32 [ 698 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stdout:4 (cluster.py:146, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Command:[docker volume prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:21:32 [ 698 ] DEBUG : Volumes pruned: 4 (cluster.py:958, cleanup) =============================== warnings summary =============================== test_reload_client_certificate/test.py: 33 warnings /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:225: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated context = ssl.SSLContext(ssl.PROTOCOL_SSLv23) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 191.45s call test_reload_client_certificate/test.py::test_wrong_cn_cert 80.64s setup test_redirect_url_storage/test.py::test_predefined_connection_configuration 67.12s call test_replicated_database/test.py::test_recover_digest_mismatch 59.76s call test_replicated_database/test.py::test_alters_from_different_replicas 55.64s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 49.91s call test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 45.93s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 41.78s call test_replicated_database/test.py::test_modify_comment 40.99s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 39.88s call test_reload_zookeeper/test.py::test_reload_zookeeper 39.55s call test_reload_client_certificate/test.py::test_correct_cn_cert 31.56s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 31.28s setup test_s3_cluster/test.py::test_ambiguous_join 30.14s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 29.66s setup test_replicated_database/test.py::test_all_groups_cluster 25.86s setup test_reload_client_certificate/test.py::test_correct_cn_cert 24.69s setup test_replica_can_become_leader/test.py::test_can_become_leader 23.11s call test_replicated_database/test.py::test_table_metadata_corruption 22.92s teardown test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 22.79s setup test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 22.55s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 22.41s teardown test_s3_cluster/test.py::test_wrong_cluster 22.27s teardown test_redirect_url_storage/test.py::test_url_without_redirect 22.09s call test_quorum_inserts/test.py::test_insert_quorum_with_ttl 22.07s teardown test_s3_assume_role/test.py::test_using_assumed_creds 21.93s call test_replicated_database/test.py::test_force_synchronous_settings 21.16s teardown test_quorum_inserts/test.py::test_simple_add_replica 21.02s call test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 20.46s call test_replicated_database/test.py::test_auto_recovery 19.31s setup test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 19.21s setup test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 18.72s setup test_s3_assume_role/test.py::test_using_assumed_creds 18.69s setup test_prometheus_endpoint/test.py::test_prometheus_endpoint 18.15s setup test_regexp_logger/test.py::test_regexp_pattern_update 18.09s call test_recovery_time_metric/test.py::test_recovery_time_metric 17.37s setup test_session_log/test.py::test_grpc_session 16.93s setup test_reload_zookeeper/test.py::test_reload_zookeeper 16.82s setup test_recovery_time_metric/test.py::test_recovery_time_metric 16.54s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 16.48s call test_replicated_database/test.py::test_server_uuid 16.17s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 15.99s call test_replicated_database/test.py::test_replicated_table_structure_alter 15.89s setup test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 14.75s call test_s3_cluster/test.py::test_cluster_default_expression 14.54s call test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 14.30s setup test_send_crash_reports/test.py::test_send_segfault 14.25s setup test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 13.99s call test_s3_cluster/test.py::test_hive_partitioning 13.49s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 12.05s call test_regexp_logger/test.py::test_regexp_pattern_update 11.83s call test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 11.62s call test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 11.32s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 10.75s setup test_read_temporary_tables_on_failure/test.py::test_different_versions 10.24s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 9.89s call test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 9.82s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 9.37s call test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 9.10s call test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 9.03s call test_replicated_database/test.py::test_flatten_nested 8.76s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 8.72s call test_replicated_database/test.py::test_simple_alter_table[MergeTree] 8.63s teardown test_prometheus_endpoint/test.py::test_prometheus_endpoint 8.16s call test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 7.99s call test_s3_cluster/test.py::test_distributed_s3_table_engine 7.65s teardown test_reload_zookeeper/test.py::test_reload_zookeeper 7.54s call test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 7.52s call test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 7.46s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 7.26s call test_replicated_database/test.py::test_alter_attach[MergeTree] 7.24s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 7.16s call test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 7.15s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 7.01s teardown test_replicated_database/test.py::test_table_metadata_corruption 6.93s call test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 6.84s call test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 6.75s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 6.55s call test_read_temporary_tables_on_failure/test.py::test_different_versions 6.54s call test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 6.42s teardown test_read_temporary_tables_on_failure/test.py::test_different_versions 6.36s call test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 6.34s teardown test_reload_client_certificate/test.py::test_wrong_cn_cert 6.22s call test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 6.22s call test_replicated_database/test.py::test_alter_fetch 6.09s call test_quorum_inserts/test.py::test_simple_add_replica 5.99s teardown test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 5.95s call test_s3_cluster/test.py::test_cluster_format_detection 5.80s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 5.79s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 5.62s teardown test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 5.58s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 5.56s teardown test_regexp_logger/test.py::test_regexp_pattern_update 5.49s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 5.41s call test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 5.28s teardown test_replica_can_become_leader/test.py::test_can_become_leader 5.23s call test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 5.19s call test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 4.91s call test_replicated_database/test.py::test_create_replicated_table 4.90s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 4.85s call test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 4.85s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 4.76s call test_replicated_database/test.py::test_delete_from_table[MergeTree] 4.62s call test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 4.60s call test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 4.57s call test_replicated_database/test.py::test_alter_detach_part[MergeTree] 4.53s call test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 4.42s call test_replicated_database/test.py::test_alter_drop_part[MergeTree] 4.11s call test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 3.92s call test_replicated_database/test.py::test_all_groups_cluster 3.91s call test_session_log/test.py::test_grpc_session 3.89s teardown test_session_log/test.py::test_mysql_session 3.84s teardown test_send_crash_reports/test.py::test_send_segfault 3.54s call test_session_log/test.py::test_mysql_session 3.36s call test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 3.23s call test_s3_cluster/test.py::test_cluster_with_header 3.18s call test_s3_cluster/test.py::test_cluster_with_named_collection 3.06s call test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 2.88s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 2.77s call test_replicated_database/test.py::test_detach_attach_table 2.68s call test_s3_cluster/test.py::test_count_macro 2.58s call test_prometheus_endpoint/test.py::test_prometheus_endpoint 2.32s call test_polymorphic_parts/test.py::test_polymorphic_parts_index 2.10s call test_s3_cluster/test.py::test_union_all 2.05s setup test_replicated_database/test.py::test_alter_attach[MergeTree] 2.05s call test_s3_cluster/test.py::test_ambiguous_join 1.96s call test_redirect_url_storage/test.py::test_predefined_connection_configuration 1.85s call test_redirect_url_storage/test.py::test_url_with_globs 1.79s call test_redirect_url_storage/test.py::test_url_with_globs_and_failover 1.78s call test_redirect_url_storage/test.py::test_url_with_redirect_allowed 1.76s call test_s3_cluster/test.py::test_count 1.70s teardown test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 1.65s teardown test_recovery_time_metric/test.py::test_recovery_time_metric 1.46s call test_s3_cluster/test.py::test_select_all 1.41s call test_redirect_url_storage/test.py::test_url_without_redirect 1.33s call test_s3_cluster/test.py::test_remote_hedged 1.17s call test_s3_cluster/test.py::test_skip_unavailable_shards 1.16s call test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 1.05s call test_s3_cluster/test.py::test_remote_no_hedged 1.01s call test_s3_cluster/test.py::test_wrong_cluster 1.00s call test_s3_cluster/test.py::test_unset_skip_unavailable_shards 0.74s call test_replica_can_become_leader/test.py::test_can_become_leader 0.57s call test_s3_assume_role/test.py::test_using_assumed_creds 0.42s call test_send_crash_reports/test.py::test_send_segfault 0.01s setup test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 0.00s teardown test_replicated_database/test.py::test_all_groups_cluster 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 0.00s teardown test_redirect_url_storage/test.py::test_predefined_connection_configuration 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 0.00s teardown test_reload_client_certificate/test.py::test_correct_cn_cert 0.00s teardown test_s3_cluster/test.py::test_ambiguous_join 0.00s teardown test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 0.00s setup test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 0.00s setup test_reload_client_certificate/test.py::test_wrong_cn_cert 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_s3_cluster/test.py::test_distributed_s3_table_engine 0.00s setup test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 0.00s setup test_s3_cluster/test.py::test_unset_skip_unavailable_shards 0.00s setup test_replicated_database/test.py::test_delete_from_table[MergeTree] 0.00s setup test_replicated_database/test.py::test_table_metadata_corruption 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 0.00s setup test_redirect_url_storage/test.py::test_url_without_redirect 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 0.00s setup test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_force_synchronous_settings 0.00s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s setup test_replicated_database/test.py::test_simple_alter_table[MergeTree] 0.00s teardown test_replicated_database/test.py::test_modify_comment 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.00s setup test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_modify_comment 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s setup test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 0.00s setup test_replicated_database/test.py::test_flatten_nested 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s setup test_replicated_database/test.py::test_recover_digest_mismatch 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 0.00s setup test_replicated_database/test.py::test_create_replicated_table 0.00s setup test_s3_cluster/test.py::test_cluster_default_expression 0.00s setup test_replicated_database/test.py::test_detach_attach_table 0.00s setup test_redirect_url_storage/test.py::test_url_with_globs 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s teardown test_replicated_database/test.py::test_create_replicated_table 0.00s setup test_replicated_database/test.py::test_server_uuid 0.00s setup test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 0.00s setup test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_alter_fetch 0.00s teardown test_replicated_database/test.py::test_delete_from_table[MergeTree] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s setup test_replicated_database/test.py::test_alter_detach_part[MergeTree] 0.00s setup test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 0.00s setup test_redirect_url_storage/test.py::test_url_with_redirect_allowed 0.00s teardown test_replicated_database/test.py::test_alter_detach_part[MergeTree] 0.00s teardown test_replicated_database/test.py::test_server_uuid 0.00s teardown test_replicated_database/test.py::test_simple_alter_table[MergeTree] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 0.00s setup test_s3_cluster/test.py::test_union_all 0.00s setup test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 0.00s teardown test_replicated_database/test.py::test_replicated_table_structure_alter 0.00s teardown test_replicated_database/test.py::test_detach_attach_table 0.00s teardown test_replicated_database/test.py::test_auto_recovery 0.00s teardown test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 0.00s teardown test_redirect_url_storage/test.py::test_url_with_globs_and_failover 0.00s teardown test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 0.00s teardown test_replicated_database/test.py::test_recover_digest_mismatch 0.00s teardown test_s3_cluster/test.py::test_skip_unavailable_shards 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.00s setup test_replicated_database/test.py::test_replicated_table_structure_alter 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.00s setup test_replicated_database/test.py::test_alters_from_different_replicas 0.00s setup test_s3_cluster/test.py::test_hive_partitioning 0.00s setup test_s3_cluster/test.py::test_cluster_with_header 0.00s teardown test_replicated_database/test.py::test_force_synchronous_settings 0.00s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 0.00s setup test_s3_cluster/test.py::test_wrong_cluster 0.00s setup test_s3_cluster/test.py::test_select_all 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_ttl 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 0.00s setup test_s3_cluster/test.py::test_remote_hedged 0.00s setup test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 0.00s teardown test_replicated_database/test.py::test_flatten_nested 0.00s setup test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_replicated_database/test.py::test_auto_recovery 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s teardown test_replicated_database/test.py::test_alter_fetch 0.00s teardown test_replicated_database/test.py::test_alter_drop_part[MergeTree] 0.00s teardown test_replicated_database/test.py::test_alters_from_different_replicas 0.00s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 0.00s setup test_s3_cluster/test.py::test_remote_no_hedged 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 0.00s setup test_redirect_url_storage/test.py::test_url_with_globs_and_failover 0.00s teardown test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 0.00s setup test_s3_cluster/test.py::test_count_macro 0.00s setup test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 0.00s teardown test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_alter_drop_part[MergeTree] 0.00s setup test_s3_cluster/test.py::test_count 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 0.00s teardown test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 0.00s teardown test_replicated_database/test.py::test_alter_attach[MergeTree] 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 0.00s teardown test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_session_log/test.py::test_mysql_session 0.00s teardown test_session_log/test.py::test_grpc_session 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s setup test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 0.00s setup test_quorum_inserts/test.py::test_simple_add_replica 0.00s setup test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s teardown test_s3_cluster/test.py::test_hive_partitioning 0.00s call test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_cluster/test.py::test_remote_no_hedged 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 0.00s setup test_s3_cluster/test.py::test_cluster_with_named_collection 0.00s teardown test_s3_cluster/test.py::test_cluster_format_detection 0.00s setup test_s3_cluster/test.py::test_skip_unavailable_shards 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 0.00s teardown test_s3_cluster/test.py::test_unset_skip_unavailable_shards 0.00s setup test_s3_cluster/test.py::test_cluster_format_detection 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_ttl 0.00s teardown test_redirect_url_storage/test.py::test_url_with_globs 0.00s teardown test_s3_cluster/test.py::test_count_macro 0.00s teardown test_redirect_url_storage/test.py::test_url_with_redirect_allowed 0.00s teardown test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_cluster/test.py::test_count 0.00s teardown test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 0.00s teardown test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s teardown test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 0.00s teardown test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 0.00s teardown test_s3_cluster/test.py::test_cluster_with_named_collection 0.00s teardown test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 0.00s teardown test_s3_cluster/test.py::test_select_all 0.00s teardown test_s3_cluster/test.py::test_cluster_default_expression 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_s3_cluster/test.py::test_remote_hedged 0.00s teardown test_s3_cluster/test.py::test_distributed_s3_table_engine 0.00s teardown test_s3_cluster/test.py::test_cluster_with_header 0.00s teardown test_s3_cluster/test.py::test_union_all 0.00s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] =========================== short test summary info ============================ FAILED test_s3_assume_role/test.py::test_using_assumed_creds - helpers.client... PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 PASSED test_s3_cluster/test.py::test_ambiguous_join PASSED test_replicated_database/test.py::test_all_groups_cluster PASSED test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] PASSED test_replicated_database/test.py::test_alter_attach[MergeTree] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] PASSED test_s3_cluster/test.py::test_cluster_default_expression PASSED test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] PASSED test_replicated_database/test.py::test_alter_detach_part[MergeTree] PASSED test_s3_cluster/test.py::test_cluster_format_detection PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] PASSED test_s3_cluster/test.py::test_cluster_with_header PASSED test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] PASSED test_s3_cluster/test.py::test_cluster_with_named_collection PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] PASSED test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] PASSED test_s3_cluster/test.py::test_count PASSED test_s3_cluster/test.py::test_count_macro PASSED test_reload_client_certificate/test.py::test_correct_cn_cert PASSED test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection PASSED test_prometheus_endpoint/test.py::test_prometheus_endpoint PASSED test_replicated_database/test.py::test_alter_drop_part[MergeTree] PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions PASSED test_s3_cluster/test.py::test_distributed_insert_select_with_replicated PASSED test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] PASSED test_redirect_url_storage/test.py::test_predefined_connection_configuration PASSED test_redirect_url_storage/test.py::test_url_with_globs PASSED test_s3_cluster/test.py::test_distributed_s3_table_engine PASSED test_replicated_database/test.py::test_alter_drop_partition[MergeTree] PASSED test_redirect_url_storage/test.py::test_url_with_globs_and_failover PASSED test_redirect_url_storage/test.py::test_url_with_redirect_allowed PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] PASSED test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed PASSED test_redirect_url_storage/test.py::test_url_without_redirect PASSED test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] PASSED test_s3_cluster/test.py::test_hive_partitioning PASSED test_replicated_database/test.py::test_alter_fetch PASSED test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference PASSED test_s3_cluster/test.py::test_remote_hedged PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop PASSED test_s3_cluster/test.py::test_remote_no_hedged PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] PASSED test_s3_cluster/test.py::test_select_all PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] PASSED test_s3_cluster/test.py::test_skip_unavailable_shards PASSED test_regexp_logger/test.py::test_regexp_pattern_update PASSED test_s3_cluster/test.py::test_union_all PASSED test_s3_cluster/test.py::test_unset_skip_unavailable_shards PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] PASSED test_s3_cluster/test.py::test_wrong_cluster PASSED test_recovery_time_metric/test.py::test_recovery_time_metric PASSED test_quorum_inserts/test.py::test_simple_add_replica PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format PASSED test_replica_can_become_leader/test.py::test_can_become_leader PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive PASSED test_replicated_database/test.py::test_alters_from_different_replicas PASSED test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable PASSED test_reload_zookeeper/test.py::test_reload_zookeeper PASSED test_replicated_database/test.py::test_auto_recovery PASSED test_replicated_database/test.py::test_create_replicated_table PASSED test_replicated_database/test.py::test_delete_from_table[MergeTree] PASSED test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] PASSED test_replicated_database/test.py::test_detach_attach_table PASSED test_replicated_database/test.py::test_flatten_nested PASSED test_replicated_database/test.py::test_force_synchronous_settings PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert PASSED test_replicated_database/test.py::test_modify_comment PASSED test_session_log/test.py::test_grpc_session PASSED test_session_log/test.py::test_mysql_session PASSED test_replicated_database/test.py::test_recover_digest_mismatch PASSED test_replicated_database/test.py::test_replicated_table_structure_alter PASSED test_replicated_database/test.py::test_server_uuid PASSED test_replicated_database/test.py::test_simple_alter_table[MergeTree] PASSED test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] PASSED test_replicated_database/test.py::test_table_metadata_corruption SKIPPED [1] test_send_crash_reports/test.py:46: doesn't fit in timeouts for stacktrace generation ======= 1 failed, 98 passed, 1 skipped, 33 warnings in 430.74s (0:07:10) ======= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_8fncjv --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv" altinityinfra/integration-tests-runner:cd6390247eca ' returned non-zero exit status 1.